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[57] ABSTRACT 

A medical ultrasonic diagnostic imaging system is provided 
which is capable of being accessed over data communicatioD 
networks such as the Internet, making the ultrasonic images, 
diagnostic reports, and ultrasound system diagnostics infor- 
mation and operation accessible to a conventional personal 
computer using commercially available software at virtually 
any remote location. In one embodiment, the ultrasound 
system can be remotely operated from the personal com- 
puter. The inventive apparatus and techniques make it pos- 
sible for physicians to remotely access, control, and perform 
diagnoses using their ultrasound systems over a network 
such as the World Wide Web with no special hardware 
requirements. 

30 Claims, 17 Drawing Sheets 
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ULTRASONIC DIAGNOSTIC IMAGING 
SYSTEM WITH UNIVERSAL ACCESS TO 
DIAGNOSTIC INFORMATION AND IMAGES 

This is a divisional application of U.S. patent application 
Ser. No. 08/919,360 filed Oct 25, 1996, now U.S. Pat. No. 
5,715,823 which is a continuation in part of U.S. patent 
application Ser. No. 08/607,894 filed Feb. 27, 1996, now 
U.S. Pat. No. 5,603,323. 

This invention relates to improvements in ultrasonic 
diagnostic imaging systems which enable an ultrasound 
system to be accessed or controlled from a remote location. 

U.S. Pat. No. 5,603,323 describes an ultrasound system 
which is quickly and easily upgraded firom a remote loca- 
tion. Through two way communication with the ultrasound 
system, performance enhancements are remotely transmit- 
ted and installed without the need for a serviceman's call. 
The physician's diagnostic practice is enhanced by these 
quick and effective improvements to his or her ultrasound 
system. The present invention, among other things, provides 
a new technique for qualifying and testing such software 
upgrades for ultrasonic diagnostic systems worldwide. 

An adjunctive business to ultrasonic diagnostic imaging 
which made an appearance in the 1990's is ultrasonic image 
management. Ultrasonic image management systems com- 
prise specialized workstations, ultrasound system interfaces, 
ultrasound image storage devices and networks which are 
intended to facilitate ultrasonic diagnosis by the handling 
and storage of ultrasound images off-hne. Such systems are 
intended to allow the physician to accumulate images in a 
storage medium for later recall fi:om the workstation for 
review and diagnosis. While ultrasonic image management 
systems can offer a valuable capability for installations with 
multiple, intensively used ultrasound systems, they also 
require a considerable investment. The modules and work- 
stations of an image management system usually have prices 
ranging in the thousands of dollars. Special installation is 
generally required and image management systems often 
employ proprietary hardware and software, which can act to 
limit their versatihty. It is desirable to provide the advan- 
tages of an ultrasonic image management system without 
these numerous drawbacks. 

In accordance with the principles of the present invention 
a medical diagnostic ultrasonic imaging system is provided 
which can be remotely accessed, interrogated or controlled 
from virtually any place on the globe to provide information 
about its operating characteristics, patient images and 
reports, or even for remotely controlled system operation. 
These capabilities may stirprisingly be provided by com- 
mercially available software features and inexpensive per- 
sonal computer hardware, making the capabilities easy to 
afford and use. Embodiments of the present invention 
describe techniques for modifying an ultrasonic diagnostic 
imaging system with inexpensive and readily available 
hardware and software, enabling the diagnostic information 
gathered through use of the ultrasound system to be accessed 
from remote locations. Constructed embodiments of the 
present invention are described which provide means for 
remotely accessing configuration information from the ultra- 
sound system, running tests and diagnostics on the ultra- 
sound system from remote locations, and even the ability to 
remotely control the operation of the ultrasound system. 
Embodiments of the present invention can also provide 
many of the functions and features of commercially avail- 
able ultrasound image management systems, but for only a 
tiny fraction of the cost of a typical image management 
system. 
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A significant contribution of the ingenuity of the present 
invention resides in the adaptation of existing hardware and 
software to enable ultrasound systems to be accessed 
through an open architecture communication network, 
5 whereby image management capabilities may be provided 
through a conventional off-the-shelf personal computer with 
no special hardware, software, or expensive modifications. 

In the drawings: 

FIG. 1 illustrates in block diagram form an ultrasonic 
10 diagnostic imaging system which is constructed in accor- 
dance with the principles of the present invention to operate 
over an internetwork, together with a personal computer 
which can exchange diagnostic and ultrasound system con- 
trol information with the ultrasound machine; 
15 FIG. 2 illustrates in greater detail the internetworking 
components of the ultrasound machine of FIG. 1; 

FIG. 3 illustrates in greater detail the internetworking 
components of the personal computer of FIG. 1; 

FIG. 4 illustrates a Web home page of an ultrasound 
20 system constructed in accordance with the principles of the 
present invention as it appears when accessed over an 
internet from a remotely located personal computer or 
terminal; 

FIG. 5 illustrates a patient directory Web page for a 
25 specific patient which is accessed through the Web home 
page of FIG. 4; 

FIG. 6 illustrates an ultrasound image Web page which is 
accessed through the patient directory Web page of FIG. 5; 
FIG. 7 illustrates a patient report Web page which is 
30 accessed through the patient directory Web page of FIG. 5 
and displays an ultrasound image with no degradation in 
ultrasound image quality; 

FIG, 8 illustrates the main menu of a system diagnostics 
Web page which is accessed through the Web home page of 
35 FIG. 4; 

FIG. 9 illustrates a configuration log Web page which is 
accessed through the system diagnostics page of FIG. 8; 

FIG. 10 illustrates a system control Web page which is 
accessed through the Web home page of FIG. 4; 
40 FIG. 11 illustrates a Web home page of a network of 
ultrasound systems construaed in accordance with the prin- 
ciples of the present invention; 

FIG. 12 illustrates a patient directory Web page of one 
system of the network of ultrasound systems which is 
45 accessed through the network home page of FIG. 11; 

FIG. 13 illustrates another patient directory Web page of 
a central server which is accessed through the network home 
page of FIG. U; 

FIG. 14 illustrates a patient directory Web page of one of 
50 the systems on a network which is accessed through the 
network patient directory Web page of FIG. 13; 

FIG. 15 illustrates in block diagram form a local network 
of ultrasound systems; 

FIG. 16 illustrates in block diagram form a local network 
55 of ultrasound systems connected by a gateway to the Inter- 
net; and 

FIG. 17 illustrates in block diagram form a local network 
of ultrasound systems connected by a network modem to a 
personal computer remote from the network, 

60 TUrning first to FIG. 1, an ultrasonic diagnostic imaging 
system 10 which is constructed in accordance with the 
principles of the present invention is shown in the upper half 
of the drawing in block diagram form. The ultrasound 
system 10 is constructed to be accessed by a personal 

65 computer 100 which is remotely located. The idtrasound 
system 10 includes a number of conventional components, 
including a scanhead 12 which transmits ultrasonic waves 
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into the body of a patient, receives echoes returning &om the 
interaction of the transmitted waves with internal organs and 
tissue of the body, and converts the received echoes into 
electrical echo signals. The electrical echo signals are appro- 
priately delayed and combined by a beamformer 12 to form 5 
coherent beams of echo information. The beams of echo 
information are processed by an image processor 16 to form 
ultrasonic images, which are stored in an image store 
partition 24a of a storage medium 24. The images may also 
be further processed by a video processor (not shown) to be lo 
placed in a raster format suitable for display on a system 
display 26. 

The operation of the ultrasound system 10 is under the 
control of a control panel 20. The control panel 20 also 
enables a user to prepare diagnostic reports of the ultrasound 15 
exams performed, using a report generator software package 
22 which is stored in the ultrasound system. The diagnostic 
reports may be displayed or printed out on a printer (not 
shown), and may also be stored in a report store partition 24b 
of the storage medium 24. 20 

In accordance with the principles of the present invention 
the ultrasound system of FIG. 1 further includes a HyperText 
Transport Protocol (HTTP) server 30. The HTTP server is 
connected to access ultrasonic images and reports from the 
storage medixim 24, and makes the system's images and 25 
reports accessible to a personal computer, terminal, or 
workstation at a remote location. In FIG. 1 the server 30 is 
connected by a modem 32 to a wire (42) or wireless (44) 
communication network 40. The server 30 makes the diag- 
nostic information of the ultrasound system 10 available to 30 
users connected to access the ultrasound system through the 
communication network 40. 

The terminal of one such user is shown in the lower half 
of FIG. 1. This user has a commercially available personal 
computer (PC) 100, including a PC processor 102, a monitor 35 
108, and a keyboard 110. Installed on the personal computer 
100 is a commercially available Web browser 104 and 
network software 106, which enable the user to access the 
World Wide Web of the Internet through a modem 132. The 
user is thus able to use the commercially available PC 40 
hardware and software to communicate over the Internet 
with the ultrasound system through the server 30. 

The well known Internet is the result of developments 
known as internetwork technology, which enables comput- 
ers and computer networks at one location to communicate 45 
with computers and computer networks at other locations. 
Basic development of internetworking technology began in 
the 1960's under the leadership of the Defense Advanced 
Research Projects Agency (DARPA) of the U.S. 
government, which was responding to the needs of scientists 50 
and the military to be able to exchange information over a 
computer network. Two basic approaches to communica- 
tions networks were possible, circuit-switched networks and 
packet-switched networks. A circuit-switched network oper- 
ates by forming a dedicated circuit between two points. An 55 
example of a circuit-switched network is the U.S. telephone 
network. Once a telephone caller has been connected to 
another telephone by switching technology, the capacity of 
that circuit is estabUshed and is not diminished by any other 
use of the network. Thus the advantage of circuit switching 60 
is a guarantee of capacity once the circuit is completed. The 
disadvantage is cost, for circuit costs are fixed, regardless of 
the level of network utilization. 

Packet -switching employs a different approach. A mes- 
sage from one network user to another is broken up into 65 
discrete units of information called packets. The packets are 
directed across the network from the sender's location to 
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that of the receiver by high speed routers whidi search the 
network for a pathway from sender to receiver. At the 
receiver's location the individual packets are received and 
reassembled to reform the original message. The advantage 
of packet-switching is that the network can handle many 
messages at one time by interleaving packets from different 
senders. The disadvantage of pacto-switching is that as 
utilization of the network increases, higher volume traffic 
will slow the time required to send all of the packets of a 
message across the network. 

The packet-switching approach became the choice for 
internetworked computers due to advantages of cost and 
performance. Since many computers can share a network 
and can communicate rapidly in short packet bursts, the 
costs of dedicated circuits are avoided. Moreover, demands 
for greater capacity are met by ever-increasing computer 
performance. Advances in computer technology provide the 
ability to handle higher volumes of data at ever increasing 
rates of data transfer. 

DARPA's task was to connect numerous government and 
civilian computer networks in one unifying interconnection 
of networks, or internet. An internet is a group of intercon- 
nected networks that operate in a coordinated manner. Some 
of the most important developments which make internets 
possible came from research projects initiated by DARPA. 
This research had a very significant result: it estabUshed 
networking standards for packet-switching networks to 
communicate with each other, independent of the character- 
istics of their underlying hardware. These standards allow 
imiversal communication among computer networks, while 
allowing individual users to employ (or continue using) 
hardware of their own choosing. The common standards 
allow participants to individually employ and administer 
their own network hardware while seamlessly interacting 
with data from a universe of other users. This achievement 
led to the creation of the most famous internet connection, 
now commonly known as the Internet and its World Wide 
Web of interconnections. The present invention apphes the 
Internet advantage of universal connectibihty, and the ben- 
efits of the Wodd Wide Web, to ultrasound to enhance the 
practice of diagnostic ultrasound by the physician and 
system serviceability by an ultrasound technician. 

The Internet, as mentioned above, is a network of net- 
works which facilitates the transfer of data among numerous 
users who are connected to the network. The World Wide 
Web (the "Web**) is the name of a high level user interface 
which has been created on the Internet to make transfers of 
data easier and more logical. The Web provides users with 
a distributed menu system. Menu pages or screens are 
displayed to users through which the user can easily request 
information firom another computer, or host. The major 
power of the Web is the abiUty to nonlinearly link or jump 
from one set of information to another tlurough display 
elements called hypertext Unks. When a screen displays 
something in the characteristic of a hypertext link, generaiy 
blue text or a colored outline of a graphic, the user has the 
abihty to click on the hypertext element and immediately be 
transferred to the data or information identified by the 
hypertext, whether the data is at the same host as the 
displayed information or at some other host location some- 
where else in the world. The user has the ability to thereafter 
click back to the original screen display, or follow a 
sequence of hnks to sought-after information which can then 
be transmitted, or downloaded, from that host. On the 
Internet, Web addresses with the prefix "http://" denote Web 
screens with hypertext linking capability which conform to 
the pubhshed "RFC standards of the Internet Engineering 
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Task Force. Through hypertext linking a user is quickly able 
to follow pointers and references to the exact information 
being sought. The information returned through these links 
can be encoded to be reproduced in numerous formats, 
including text documents, images, graphics, video displays, 5 
and even audio. This power of the Web's hypertext linking 
is brought directly to ultrasound systems and diagnostic 
ultrasound information by the present invention. 

Turning now to FIG. 2, a more detailed block diagram of 
an ultrasound system constructed in accordance with the lo 
principles of the present invention is shown. The interface 
by which the system physically connects to the network is 
called a port. In FIG, 2 the ultrasound system is connected 
to an internetwork through a serial port 31. A common 
hardware device that translates between the digital domain 15 
of the ultrasound system and the analog domain of a 
telephone system is called a modem (modulator/ 
demodulator). The modem 32 converts serial digital data 
from the serial port 31 into analog signals suitable for 
transmission over telephone lines. The modem also trans- 20 
lates incoming analog telephone signals into digital data for 
passage through the serial port 31 and use by the ultrasound 
system. A suitable modem is available from Hayes Micro- 
computer Products, Inc., which has established standards 
used by a number of modem manufacturers. 25 

Communication with the modem 32 is established by 
software known as PPP (point-to-point protocol) software as 
shown in block 48 of the drawing. PPP is a standard that 
enables multiple network protocols to be used over a modem 
line or other serial cormection. Other standards can be used 30 
such as SLIP (Serial Line Intemet Protocol), a standard that 
permits a commuDications protocol known as TCP/IP 
(discussed below) to be used over a modem line or other 
serial connection, or CSLIP (Compressed Serial Line Inter- 
net Protocol), a specialized form of SLIP. After the PPP 35 
software has been installed in the ultrasound system, it must 
be initialized or configiired for the ultrasound system and 
modem with which it is operating. Configuration informa- 
tion controls the PPP software to be compatible with char- 
acteristics such as the serial port being used, the type of 40 
modem used, the phone line, host telephone number and 
dialing method, and login procedures and passwords. In 
general, the configuration information provides settings 
relating to initiating a network connection, when a connec- 
tion is initialed, and what happens after a connection has 45 
been established. PPP software is incorporated in some 
operating system software packages such as Windows 95 
from Microsoft Corporation of Redmond, Wash, for IBM- 
compatible PCs. PPP software for Apple personal computers 
is available from InterCon Systems Corporation of Hemdon, so 
Va., among others. 

One of the accomplishments of the DARPA research 
project in internetworking was the establishment of a set of 
widely used network protocols called the TCP/IP Internet 
Protocol Suite. TCP/IP is named after its two most com- 55 
monly used protocols, the Internet Protocol (IP) and the 
Transmission Control Protocol(TCP). The IP protocol con- 
trols the routing of data and the TCP protocol controls the 
transfer of data. TCP/IP provides a common means of 
interconnection through packet transfer devices known as 60 
gateways. A gateway is a specialized internetworking com- 
puter that connects two or more networks and routes packets 
of data between them. 

When the ultrasound system has data it wishes to transfer 
over the Internet, the data is passed to TCP/IP as shown in 65 
block 46 of the drawing. TCP encapsulates data into seg- 
ments called TCP packets with header information that is 
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used to track, check and order the data segments in the 
proper sequence. Since a block of data is transmitted over 
the Intemet in discrete packets, individual ones of which 
may be routed differently by gateways, there is no assurance 
that the packets will arrive at their destination in the proper 
order or without errors. The TCP packets provide a means of 
assuring packet delivery, integrity, and sorting order. At the 
receiving end the packets are checked for errors in accor- 
dance with the TCP packet header informatioD, error-free 
segments are acknowledged, and the packets are put in order 
to reassemble the original block of data. The sender keeps 
track of segment acknowledgments, and if a segment is not 
timely acknowledged the sender retransmits the packet. If a 
segment is lost on initial transmission or received out of 
order, TCP holds the received segments until all segments 
are accounted for at the received end, at which time they 
may be ordered in their proper and complete sequence for 
reassembly of the original block of data. 

At the transmitting end, TCP packets are passed to IP, 
which puts the segments into the form of IP packets or 
datagrams. The datagram contains an IP header which 
provides addressing information used by gateways to route 
the datagram to its proper destination. The IP header con- 
tains the source and destination Internet addresses to enable 
gateways to properly route the data, and the receiver to 
acknowledge receipt of the datagram. IP makes a best-effort 
attempt to dehver all datagrams, but does not assure their 
delivery. Assurance of deUvery is provided by TCP through 
acknowledgment and retransmission as described above. 

Like the PPP software, the TCP/IP needs to be configured 
for the particular ultrasound system and its environment. 
Typical configuration information for TCP/IP includes infor- 
mation on the type of local network if the ultrasound system 
is locally networked with other ultrasound machines (e.g., 
Ethernet or token ring network), information as to the 
addresses of other systems on the local network, the gateway 
address if the system is performing a router function, the 
user name of the ultrasound machine and access password, 
the address of the servers on the ultrasound system, the 
Internet address (IP address) for the ultrasound system, and 
the default domain for the local network. Like PPP, TCP/IP 
software also comes with some system software packages 
such as Windows 95, and is available for Apple computers 
from InterCon. 

A key to successful operation of any intemet, and the 
Internet in particular, is the need for a unique address for 
every system, or "host," which is directly connected to the 
internet. Every user which connects directly to the Intemet 
must obtain an IP address from a central authority known as 
the Network Information Center (NIC), which utilizes com- 
puterized mediation to assign IP addresses to those request- 
ing them. An IP address is 32 bits in length, and is expressed 
in four decimal notations of groups of eight bits, separated 
by periods, such as 699.59.9.114 (an invahd IP address used 
as an example herein). IP addresses are classed by the size 
of the network connected to the Internet, with Class A 
addresses reserved for very large networks, Class B 
addresses for medium-sized networks (255 to 65,000 users) 
such as a university network, and Class C addresses for 
small networks (less than 256 tisers) such as a radiology 
clinic or hospital, significantly, IP addresses do not specify 
an individual computer or machine; rather, they specify a 
connection to the Internet. If an ultrasound machine has two 
network connections to the Internet, each must have a 
unique IP address. A corollary of this aspect is that a local 
network can employ subnetwork addressing in which each 
local machine has a subnetwork address, with the network 
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being connected to the Internet at a single host connection system, and limited to reading only. Access may also be 

with an IP address which provides access for all local restricted to certain users and certain numbers of simulta- 

systems to the Internet. Subnetwork addressing is permis- neous users, and passwords required. The server records the 

sible when the sub addresses of the network are not visible to location of the logfile, the file of users who have accessed the 

users of the Internet itself. 5 system. The configuration files identify the port number used 

Another type of permitted Internet addressing which the by the server and the administrator of the server. The 

NIC administers is domain name addressing. Since many configuration files store the location of files used by the 

users would prefer being addressed by meaningful words of server, including the server root directory and the addresses 

a language rather than numbers, the NIC can assign a user of Web pages and CGI programs (described below) which 

a domain and a subdomain name, with the user fi'ee to add lO are used by the server. Other characteristics for which the 

further subdomain names for which it has mapping respon- server may be configured include such features as multilin- 

sibility for its network. The domain is the major gual capability. 

classification, with commercial users being assigned the In response to external requests the HTTP server 30 

domain name COM, educational institutions the domain transmits HyperText Markup Language (HTML) pages 34 to 

name EDU, goverameat institutions the domain name GOV, 15 an inquiring Web browser. HTML pages describe what the 

and so forth. A hypothetical domain Dame for the ultrasound Web browser will display on the screen at the remote 

department of a Veterans Administration hospital owned by terminal, including buttons, text, images, animated real time 

the U.S. government might be loops of images, sounds, and so forth. HTML pages may be 

ULTRAS0UND.VAH0SPITAL.GOV, for instance. directly encoded in software by following the instruction 

In FIG. 2 TCP/IP is connected to a local network 20 published in a number of reference texts such as HTML and 

medium, in this case an Ethernet connection 50. The Eth- CGI Unleashed, by John December and Mark Ginsburg, 

emet connection 50 connects the ultrasound system to other pubUshed by Sams.net Publishing, Indianapolis, Ind. Simple 

systems on a local network. In an Ethernet network the HTML pages may be written using commercially available 

systems on the network must be within a maximum allow- desk-top publishing and word processing software, then 

able distance of each other and are all connected to the same 25 encoded in HTML form using software known as the 

physical network wiring. Data can be transmitted on the Internet Assistant, which may be downloaded through 

Ethernet network at high speed (previously 10 Megabits per Microsoft's homepage at www.microsoft.com. 

second; current versions have speeds of up to 100 Megabits Alternatively, pubhc domain software known as "Web- 

per second), with each system permitted to transmit only makef' may be downloaded from the Internet and used to 

when no other system is currently transmitting over the 30 make Web pages. Web pages contain HTML tags of data 

system. A technique called Carrier Sense Multiple Access which describe how the page is to be interpreted by a Web 

with Collision Avoidance (CSMA/CA) prevents two sys- browser at the remote terminal. links to ultrasound image 

terns from using the network wiring simultaneously. The files are provided by IMG tags in the Web page code. An 

ultrasound system may be connected in other types of local HREF hypertext reference provides a means for linking to 

networks such as a token ring network, in which all systems 35 other Web pages on the same ultrasound machine, or to Web 

are connected in a continuous chain which passes informa- pages on any other host machine on the network or Web, 

tion through every system on the network. TCP/IP is con- Once the HTML pages are created they are copied to the 

figured in the illustrated embodiment for communication tiltrasound machine and their storage addresses provided to 

over the local Ethemet, or over the worldwide Internet. the HTTP server. Whenever a remote terminal asks to view 

Interacting with the TCP/IP and PPP network software is 40 a particular Web page of the ultrasound machine, the HTTP 

the HTTP server 30. The HTTP server is a software program server 30 is responsible for finding the page and sending its 

with which a Web browser communicates to access infor- contents back to the requester. 

mation from the ultrasound system. The HTTP server The ultrasound system of FIG. 2 includes a number of 
responds to external requests by displaying Web pages of small executable programs called Common Gateway Inter- 
information and hypertext connections to additional Web 45 face (CGI) programs as shown at 36. The CGI programs 
pages and information such as ultrasound images and provide an interface between the HTML pages and the 
reports. The HTTP server also responds to external requests hardware and software of the ultrasound system. The CGI 
to perform a specific action associated with a button or programs communicate with the ultrasound system, asking 
control on the ultrasound system, as described more fuUy the system to perform actions or provide requested infor- 
below. so mation such as images, reports, or current status. In a 

A constructed embodiment of the present invention uses constructed embodiment the CGI programs respond to exter- 

a popular Web server known as Apache, which was com- nal requests for information by dynamically creating custom 

piled and installed on the ultrasound system. The Apache HTML pages in which the requested information is embed- 

server is public domain software which may be downloaded ded. The following examples illustrate the operation of CGI 

from the Internet at the address http://www.apache.org/, and 55 programs that provide patient directories of ultrasound 

conforms to NCSA standards. Care must be taken when images and reports (patdir), display of a selected ultrasound 

downloading software, particularly for commercial use, so image (dispimage), general purpose programs that execute 

that the copyright laws and the rights of software owners and tasks in response to input arguments (doaction), perform 

developers are properly observed. system diagnostics (dodiag), and provide patient directories 

The server, like the previously described software, must 60 for a number of ultrasound machines on a network 

be specially configured for the ultrasound system. The (serverdir). 

Apache server has over 250 directives for configuring the The CGI programs in the constructed embodiment are 

server for its intended application. One important configu- stored on the ultrasound system's hard disk in a directory 

ration file of Apache deals with security. This configuration called "cgi-bin." In performing their operations the CGI 

file controls the access of outsiders to elements of and 65 programs access ultrasound images and reports which are 

information on the ultrasound system. Access may be lim- stored at 24, accesses and executes diagnostic routines 

ited to specified drives, directories and files of the ultrasound stored at 28, and interacts with the controls of the ultrasound 
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system through the ultrasound system controller 18. As an "Image" or "Cineloop" options above the small images, 
example of a CGI program. Table 1 illustrates the coding of When the remote terminal user clicks on "Image" and then 
a CGI program which fetches an ultrasound image and on the small image 212, the HTTP server 30 of the ultra- 
embeds the image in an HTML page. In the constructed sound system returns a Web page with a large rendition of 
embodiment the CGI programs are compiled in the C 5 the selected image as shown in FIG. 6. The address bar in 
language for speed of execution and security from remote FIG. 6 shows that the ultrasound system has transmitted an 

tampering. CGI programs can also be used to format ultra- image identified as "DAr_SR V\ which is stored in the 

sound images into a data format that is compatible with Web "GIF" image format. For speed of transmission the small 

pages. In the constructed embodiment such reformatting is images of the patient directory of FIG. 5 can be compressed 

not necessary, however, since the ultrasound system is lo and readable in accordance with the JPEG standard, whereas 

designed to store ultrasoimd images in the GIF (Graphic the full size image of FIG. 6 is transmitted without loss of 

Interchange Format) format, an image format which can be image quality using the GIF image format 

read by most Web browsers. By cHcking on the browser's "Back" button at the upper 

The specially modified ultrasound system of FIG. 2 can left of FIG. 6 the remote terminal user returns to the Web 

be accessed by a standard Intemet compatible personal 15 page of FIG. 5. The remote terminal user can now click on 

computer terminal as shown in FIG. 3. The personal com- the Patient Report button 216. In response to activation of 

puter central processing unit (CPU) executes the PC's this hypertext link button, the HTTP server 30 causes the 

software in response to actions on the keyboard 110 and execution of a CGI program called "prtrcport," which 

mouse (not shown) and displays ultrasound data and images retrieves diagnostic reports for the identified patient which 

on the screen of the monitor 108. The CPU executes the Web 20 are stored in storage 24b and embeds them in a Web page for 

browser software 104 to access the Intemet through TCP/IP transmission by the server. The server returns the Web page 

and PPP protocols 146 and 148 configured for the personal shown in FIG. 7, which contains patient report information, 

computer. Connection to a network is through the PCs serial The Internet functionality which is brought to ultrasound by 

port 131 and a modem 132. The PC may be networked to the present invention provides a further feature, which is the 

other devices through an Ethernet connection 150. The 25 capability for the remote terminal user to fashion a new 

TCP/IP and PPP may be obtained from the sources listed patient report or edit an old one. On the same terminal the 

above. The Web browser software 104 may be obtained from remote terminal xiser opens a word processing application, 

Netscape Communications Corporation of Mountain View, Using the "Edit" feature at the top of the browser in FIGS. 

Calif . or the Intemet Explorer browser may be obtained from 6 and 7, the remote terminal user copies the ultrasound 

Microsoft Corporation and is generally included with Win- 30 image and the patient report, and in tum pastes them into a 

dows 95 operating software. It is seen that no special word processing document. The remote terminal user can, 

hardware or software beyond that which is readily commer- for instance, paste the ultrasound image first, then the patient 

cially available is needed to access the ultrasound system of report below the image. The user can then edit the text file 

the present invention. of the patient report, modifying the received report or 

Some examples of the xise of an ultrasound system 35 creating a new one. Using graphics features of the word 

constructed in accordance with the principles of the present processing program the remote terminal user can circle, 

invention are shown with reference to FIGS. 4 through 14. draw on, or point to specific features of the ultrasound image 

These figures, except for reference numerals and the exem- for easy reference firom the report. The new report can be 

plary IP address, are actual prints of Web browser screens filed away on the remote terminal or to a remote location, or 

taken while the browser of a remote terminal was in com- 40 even e-mailed over the Intemet directly from the remote 

munication with a constructed embodiment of the present user's terminal to a referring physician. Additionally, the 

invention. patient report with its images can be printed out directly 

FIG. 4 shows the home Web page of an ultrasound from a computer printer connected to the remote user's 

system constructed in accordance with the present invention terminal. 

andidentifiedasHDI1000#l. As the figure shows, this Web 45 Using the Back button again (or an appropriate 
homepage was acquired by a Netscape Web browser. The hyperlink), the remote terminal user can return to the home- 
usual browser control buttons are seen above the Web URL page of FIG. 4. When the remote terminal user cUcks on the 
indicator 202. The URL indicator 202 shows the address second hypertext button 206, Perform System Diagnostics, 
used to contact ultrasound system HDI 1000 #1, which is the HTTP server 30 transmits the linked system diagnostics 
http://699.59.9.114/hdil.html. The html suffix on the address 50 menu Web page shown in FIG. 8. Each of the hypertext 
denotes the display as a hypertext Web page. linked buttons on the system diagnostics menu will cause the 
In the center of the homepage of FIG. 4 are three execution of a CGI program "dodiag" with a different 
hypertext buttons providing links to other ultrasound infor- argument, which causes the ultrasotmd system to perform a 
mation or controls. When the user at the remote terminal system diagnostic or display system status information such 
clicks the first button 204 with a computer mouse or key- 55 as test and error logs. These remote control functions are 
board key, View Save/Recall Data, a CGI program "patdir" desirable when performing remote diagnosis of the oper- 
is executed which creates a patient information Web page in ability of the ultrasound system. For instance, clicking on 
which ultrasound images of the patient are embedded and a button 222, Perform Configuration Test, causes the dodiag 
hypertext link provided to patient reports on that patient. CGI program to execute the ultrasound system's stored 
This patient directory Web page is shown in FIG. 5. This 60 ultrasound diagnostic routines 28 and retum a Web page 
Web page contains two small ultrasound images 212 and 214 containing a log of the results of those tests as shown in FIG. 
which were obtained from the ultrasound system's image 9. 

store 24a. The remote terminal user may click on either of The ability to perform diagnostic tests on the ultrasound 

these small images to see a full size rendering of the image system remotely is especially useful following the remote 

with its original image quahty, or play the real time image 65 installation of ultrasound software upgrades. After the new 

sequence represented by the small image. The remote ter- software is installed, this capability is used to execute a 

minal makes an election of these options by clicking on the system diagnostic routine which exercises the new software 
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and validates its performance. As in FIG. 9, the results of sician can switch back and forth between the 2D and Color 

these validation tests are returned to the remotely located modes or any other desired mode, alternately studying tissue 

installer, verifying the successful installation of the new structure and blood flow conditions. In another embodiment 

software. physician could switch between individual 2D images of 

Another capabihty of the system diagnostics menu of 5 a sequence of spatially different images and the 3D mode, 

FIG. 8 which is especially useful for ultrasound software where the sequence of spatially discrete images can be 

upgrades is button 224, Show System Version Numbers. rendered in a three dimensional presentation. Dif&cult diag- 

Clicking on this button causes the ultrasound diagnostics ^^^^ ^^^^^ ^ "^^^^ appropriate spedal- 

programs to return the level or version numbers of the ^^f^^ ^>?^°° ^ ^ notice Tekmcdicme 

software installed in the ultrasound system. Knowing the 10 telexammatxon as the reach of the diagnosing 

1 , ^ , 4:^ • physician is now unbounded by geography, 

current version or level of the ultrasound system software is \^ constructed embodiment, The ultrasound system 

a necessary prerequisite to the mstallation of any ultrasound ^ ^^^^ ^ ^^^^^^ computer architecture and 

system upgrade. . ^ . ^ carries out the functions of the ultrasound machine with a 

The Perfomi System DiagnosUcs functions can be per- multi-tasking operating system, as described in U.S. Pat. 
formed by an on-site serviceman using a laptop computer 15 [appi. SN ArL-140], filed Sep. 12, 1996. This operating 
When the serviceman is with the ultrasound system, there is architecture makes it possible for the ultrasound system to 
no need for modem interconnection; the network link can be be used for diagnostic exams in the normal manner while a 
made direcdy. In this case a cable is connected from the remote terminal user simultaneously interrogates the ultra- 
serial port 131 of the laptop computer (FIG. 3) to the serial sound system for images, reports, and information. The 
port 31 of the ultrasound system (FIG. 2). Alternately, of 20 multi-tasking operating system enables the central processor 
course, the Ethernet connections 50 and 150 could be of the ultrasound system to carry out normal ultrasonic 
interconnected. In either case, access and interrogation of unaging tasks and network communications tasks in a time 
the ultrasound system by the repairman proceeds as interleaved manner. To the operator at the system and the 
described above, but at the much faster data rate of a direct interrogator at the remote terminal, their separate functions 
network connection. Thus, a visiting serviceman can use his 25 appear to each of them to be executed in real time, without 
laptop computer to perform system diagnostics, check error conflict with the activities of the other. This means, for 
logs, verify configurations and software levels, and other instance, that a physician can monitor the progress of an 
system maintenance and repair activities. idtrasonographer operating the ultrasound system, retrieving 

Chcking Back to the ultrasound system's homepage of images for diagnosis and patient reports from the ultrasound 

FIG. 4, it is seen that a third hypertext button 208 is 30 system for one patient while the ultrasonographer is in the 

available, System Operation Control. Chcking on this button process of conducting a diagnostic examination of another 

208 causes the HTTP server 30 to execute a CGI program patient. 

called ^'syscontror. The syscontrol CGI program creates a The foregoing Web browser screens were acquired from 

Web page in which is embedded the ultrasound image most the network server of an individual ultrasound system. As 

recently produced by the ultrasound system as shown in the 35 indicated above, it is also possible to connect a number of 

center of FIG. 10. To the right of and below the ultrasound ultrasound systems in a local network which utilizes a single 

image are displayed user controls of the ultrasound system. server connected to the Internet. The local network server 

The displayed controls of the ultrasound system are all mcludes the communication elements 30, 31, 34, 36, 46 and 

hypertext graphics. Clicking on these buttons causes the 48 of the ultrasotmd system of FIG. 2. The Web homepage 

syscontrol CGI program to command the ultrasound system 40 of such a local network of ultrasound systems is shown in 

controller 18 to change the operation of the ultrasound FIG. 11. As the Netscape address bar shows, the remote 

system in accordance with the function of the selected terminal user's Web browser is accessing the IP address 

control. In the constructed embodiment the buttons to the 699.59.9.114 of the HDI Server for the local network. The 

right of the ultrasound image depict the system's hardkey HDI Server 234 is the only machine with a connection to and 

mode control switches, and the buttons below the image 45 address on the Internet; the ultrasound systems all have 

depict softkey controls used to change system parameters subnetwork addresses on the local network, such as hdil, 

operable in the selected mode. The lowest depicted hardkey, hdi2, hdi3, etc., which are administered by the HDI Server 

Update, is not an ultrasound system control, but a control for 234. The local network server is depicted in the lower 

this remote control feature of the present invention. Clicking graphic 234' of the homepage, and above the server are 

on Update will cause the HTTP server and CGI programs of 50 graphics for eight ultrasound systems connected to the local 

the ultrasound system to update the remotely displayed network. Two of the ultrasound systems, HDI 1000 #1 and 

image with the ultrasound image produced most recently by HDI 1000 #7, are seen to be highlighted with a solid border, 

the ultrasound system. This highlighting appears as a bright color on the Web 

These capabilities mean that a physician can perfonn an browser screen and indicates that these two systems are 

ultrasound exam from distances of thousands of miles from 55 currentiy active on the local network- Clicking on either of 

the patient, needing only a pair of hands at the patient's them will take the remote terminal user to the homepage for 

location to hold and manipulate the ultrasound probe. The the selected system. Clicking the graphic for HDI 1000 #7 

skills of eminent radiologists and echocardiologists can now system will execute an HREF link on the local network 

be brought to bear on a diagnostic situation anywhere in the server to the HTTP server of the HDI 1000 #7 system, which 

world. Any EMT or medical corpsman can hold and manipu- 60 will return the system homepage as shown in FIG. 12. From 

late the probe as directed by the remotely located physician this homepage for the #7 system the remote terminal user 

while the physician conU*ols the operation of the machine to can access patient reports and images, delete exams from 

produce the best, most diagnostic ultrasound image. Since system storage, perform system diagnostics, or connect 

the Internet connection can send and receive audio as well directly to System Operation Control to control the opera- 

as video information, the instructions of the physician to the 65 tion of the HDI 1000 #7 system. 

holder of the ultrasound probe can be sent over the same An advantage of the local network is that all systems on 

Internet connection as the ultrasound information. The phy- the network can utilize the local server to store ultrasound 
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images and patient reports, making them accessible to 
remotely located diagnosing physicians even when the ultra- 
sound systems are not in operation. When all of the net- 
work's ultrasound systems use the HDI Server 234 for 
storage of their diagnostic results, all of this informadon will 5 
be accessible over the Internet even when the ultrasound 
systems are disconnected for use elsewhere or turned off at 
the end of a day. A remote user terminal can connect to the 
HTTP server 30 of the HDI Server 234 and, at the homepage 
of FIG. 11, click on the HDI Server graphic 234 to take the lO 
remote user to the patient directory Web page shown in FIG. 
13. This patient directory page lists the names of all patients, 
with reports or images stored on the local network HDI 
Server 234, and the identity of the ultrasound system on 
which the patient was examined. The remote terminal user is 
can click on a patient's name to access the reports and 
ultrasound images from that patient's exams, or delete the 
patient's records from the HDI Server 234 after they have 
been reviewed by the physician or archived. At the bottom 
of the screen the user is able to link to the ultrasound systems 20 
which are presently active on the local network. If the 
remote terminal user Selects the name of a patient on the 
Web page of FIG. 13, the images and reports of the selected 
patient are retrieved and displayed by the local network 
server as shown by the patient directory screen of FIG. 14. 25 
As in the case of the Web page of FIG, 5, hypertext hnks are 
made to ultrasound images and reports from the patient 
directory page. 

A number of local ultrasoimd network configurations are 
shown in FIGS. 15-17. In FIG. 15, four ultrasound systems, 30 
a personal computer 244, and a local network server 242 are 
connected in a local network by a hub 240. The hub 240 is 
a simple device for interconnecting several serial data lines 
and is commercially available for a cost of about $250 from 
Farallon Corporation. The local network server 242 hard- 35 
ware can be no more than a personal computer with the 
network communications elements listed above and with 
extended storage for retention of a large volume of ultra- 
sound images and reports stored by the network's ultrasound 
systems. A user at the personal computer 244 can access the 



local network server and individual active ultrasound sys- 
tems of this local network, or "intranetwork", in the same 
manner as described above for the externally accessible 
"internetwork." 

The network arrangement of FIG. 16 is similar to that of 
FIG. 15, except that the local network is now Internet 
accessible through a gateway 250. Since it is expected that 
most physicians will not want to administer and maintain 
their own gateways and routers, the gateway will most 
commonly be effected through modem or high data rate 
connection to an Internet service provider. For a low 
monthly service charge the Internet service provider can 
deal with the internetworking intricacies in which the phy- 
sician has great reliance but little operational interest. 

Finally, FIG. 17 illustrates a network configuration by 
which a physician can directly access his ultrasound system 
network, with or without the Internet. The hub 240 is 
connected to a net/modem 252 which can be accessed over 
wireless or telephone networks 40 firom a remote personal 
computer 100. Using high level communication protocols 
such as File Transfer Protocol (FTP) or Network File 
Sharing (NFS) which use the lower level TCP/IP as a 
foundation, the physician can dial into his network directly 
and access diagnostic information, without the need for 
Internet access. For users who require only specific limited 
access to their ultrasound system networks, the arrangement 
of FIG. 17 provides an easy and secure means for a 
physician to remotely access his ultrasound system network 
and its information. 

The Internet and World Wide Web ultrasound capabilities 
of the present invention, when embodied in the form of 
software, can be easily installed as an upgrade to an existing 
ultrasound system without these capabilities, either by 
directly installing the software in the ultrasound system and 
connecting a modem or network hardware. Installation of 
the software upgrade can even be done remotely as 
described in U.S. patent [application Ser. No. 08/607,894], 
or simple instmctions given to the ultrasound system owner 
by the system manufacturer to enable the owner to install the 
capability himself. 



TABLE 1 



•* JFilename: patdii.c $ 

** 

*• (C) Copyright 1996 Advanced Technology Labs 
All Rights Reserved 

#include <exec/types.h> 
#include <dos/dos.h> 
#includc <stdio.h> 
[nain(int aigc,char * *aTgv) 
{ 

ULONG h_count,i; 
h_count - 0; 

if(Opcii RcsourccsQ) 

{ 

/* Header V 
r */ 

prmtf("Content-type: text/html %c%c", 10,10); 

priiitf(-<HTML>\n"); 

priiitf("<BODY>\n*'); 

/* For each of the *.gif files that were saved, display */ 
/* a thumbnail image on the browser. */ 
for (i=0;i<Count;i++) 
{ 

if(h_count — 0) 
{ 

prinLf(" <TD AUGN=\"CENTERV'VAUQN=r BOTTOM\"WIDTH-97>Vn"); 



11/25/2003, EAST Version: 1.4.1 



15 



5,851,186 



16 



TABLE 1 -continued 



> 

else 

{ 

printf("<TR><rrD AUGN=\"CENTERV'VAUGN=rBOTTOM\" WIDTH»98>\n"); 
} 

priiitf("<H6><CENTER><A HREF=\"dispiniagc?iccall/DAT_SR_%d.gif\">Vn", (i+1)); 
printf("<IMG SRC=\"%/recall/DAr_SR_%d.giJ\" AIJr»V*Image %dr></A>\n", (i+1)) 
piiiitf("<BR>%d<;/CENTER></H6></TD>\n", (i+l)); 
h_count++; 
if(ll_count == 6) 
{ 

printf("</TR>\n"); 
h_couut - 0; 

} 

/* Header TTiil V 

r— V 

priiitf("</BODY>\n"); 

priiitf("</HrML>\n"); 
Close_ResoiucesQ ; 
} 



What is claimed is: 

1. A method of electronically acquiring a diagnostic 
ultrasound image over a communications network from an 
ultrasound system having a server by means of a computer, 
comprising the steps of: 

a. establishing an electronic communications link 
between said ultrasound system and said computer over 
said network; and 

b. operating said computer to cause said ultrasound sys- 
tem server to transmit an ultrasound image over said 
network for display on said computer. 

2. The method of claim 1, further comprising the step of; 

c. operating said computer to electronically store said 
ultrasound image. 

3. The method of claim 1, further comprising the step of: 
c. operating said computer to print said ultrasound image 

on a hardcopy medium. 

4. The method claim 1, further comprising the step of: 

c. operating said computer to electronically transmit said 
ultrasound image to a location remote from said com- 
puter. 

5. The method of claim 4, wherein step c. comprises the 
steps of: 

cl. operating said computer to add said ultrasound image 

to an electronic message; and 
c2. electronically mailing said electronic message to a 

location remote from said computer. 

6. The method of claim 5, further comprising the step of: 

d. operating said computer to cause said ultrasound sys- 
tem server to transmit a diagnostic report over said 
network to said computer; 

and wherein step cl. further comprises operating said 
computer to add said diagnostic report to said elec- 
tronic message. 

7. The method of any one of claims 1, 2, 3, 4, 5 or 6, 
wherein said communications network comprises the Inter- 
net. 

8. The method of claim 7, wherein step b. further com- 
prises transmitting said ultrasound image over said network 
in the form of a Web page. 

9. The method of claim 7, wherein said computer com- 
prises a personal computer (p.c). 

10. The method of claim 1, wherein step b. comprises the 
steps of: 



bl. viewing on said computer a directory of ultrasound 
images stored on said ultrasound system; and 

b2. selecting from said computer one of said ultrasound 
images, whereby said selected image is transmitted 
over said network to said computer. 

11. The method of claim 10, wherein said directory 
comprises a plurality of small images displayed simulta- 
neously. 

12. The method of claim 11, wherein said small images 
comprise compressed images. 

13. The method of claim 10, wherein said selected image 
is viewed on said computer as an uncompressed image. 

14. The method of any one of claims 1, 2, 3, 4, 5, 6 or 10, 
wherein said computer comprises a personal computer 

(P.C.). 

15. A method of electronically preparing a medical ultra- 
sound diagnosis from a computer terminal comprising the 
steps of: 

a. establishing a data hnk over a network between said 
computer terminal and an ultrasound system on which 
an ultrasonic image is stored; 

b. commanding said ultrasound system from said com- 
puter terminal to transmit said ultrasonic image over 
said network to said computer terminal; and 

c. adding the ultrasonic image received by said computer 
terminal to an electronic document on said computer 
terminal. 

16. The method of claim 15, wherein step b. further 
comprises commanding said ultrasound system from said 
computer terminal to transmit a diagnostic report over said 
network to said computer terminal; and 

wherein step c. further comprises adding the diagnostic 
report received by said computer terminal to an elec- 
tronic document on said computer terminal. 

17. The method of claim 15 or 16, further comprising the 
step of: 

d. transmitting said electronic document to a location 
remote from said computer terminal. 

18. The method of any one of claims 15 or 16, wherein 
said network comprises the Internet. 

19. The method of claim 18, wherein said ultrasound 
image is transmitted over said network in the form of a Web 
page. 

20. A method of electronically preparing and delivering a 
medical ultrasound diagnosis from a computer terminal 
comprising the steps of: 
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a. establishing a data link over a network between said 
computer terminal and an ultrasound system on which 
a diagnostic ultrasound report is stored; 

b. commanding said ultrasound system from said com- 
puter terminal to transmit said ultrasound report over 
said network to said computer terminal; and 

c. storing said ultrasound report at a destination location. 

21. The method of claim 20, wherein step c. comprises: 
c. electronically mailing said ultrasound report to a des- 
tination location. 

22. The method of claim 20, wherein step c. comprises: 

c. printing said ultrasonic report on a printer connected to 
said computer terminal. 

23. The method of claim 20, further comprising a step 15 
following step b. of: 

d. adding said ultrasound report to an electronic docimient 
on said computer terminal. 

24. The method of claim 23, wherein step c. comprises: 
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c. electronically mailing said electronic document to a 
destination location. 

25. The method of any one of claims 20, 21, 22, 23 or 24, 
wherein said ultrasound report comprises an ultrasonic 
image. 

26. The method of claim 25, wherein said ultrasound 
report comprises an ultrasonic image and textual material. 

27. The method of claim 25, wherein said network com- 
prises the Internet. 

28. The method of claim 27, wherein said ultrasound 
report is transmitted over said network in the form of a Web 
page. 

29. The method of any one of claims 20, 21, 22, 23 or 24, 
wherein said ultrasound report comprises a textual report. 

30. The method of any one of claims 15, 20, 21, 23 or 24, 
wherein said computer terminal comprises a personal com- 
puter (p.c). 
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